
200210195-1 (HPC.0013US) 



APPLICATION 



FOR 



UNITED STATES LETTERS PATENT 



TITLE: GENERATING POINTER POSITION DATA FROM 

POSITION DATA OF A POINTING DEVICE OF A 
REMOTE CONSOLE 



INVENTOR: THEODORE F. EMERSON 

1881 1 Chickadee Lane 
Tomball, Texas 77377 



and 



CHRISTOPHER J. FRANTZ 
16018 Charterstone 
Houston, Texas 77070 



200210195-1 (HPC0013US) Express Mail No: EL 990137070 US 

1 

GENERATING POINTER POSITION DATA FROM POSITION DATA 
OF A POINTING DEVICE OF A REMOTE CONSOLE 

BACKGROUND 

5 [001] Server computer systems are utilized to provide, among other uses, computing 

resources for software applications and storage repositories for data. System administrators 
perform maintenance and upkeep of the server's hardware and software. System 
administrators may access the server by using a display device, a keyboard, and a pointing 
device connected to the server. 

10 [002] Graphical-user-interface (GUI) based software applications executing on the server 
may be used by system administrators to perform maintenance and upkeep of the server 
hardware and software. Each software application GUI generally allows input and 
interaction with the software application using the keyboard and pointing device. 

[003] Alternatively, in a KVM (keyboard video monitor) arrangement, a display device, 
15 keyboard, and mouse are connected to a server management device, which in turn is 

connected to one or more ports of the server. A system administrator can access the server 
through the use of the display device, keyboard, and mouse connected to the server 
management device. 

[004] Remote management consoles such as a computer system or personal digital assistant 
20 (PDA) may also be used to remotely access and administer servers. Remote management 

consoles may be connected to the server management device to allow a system administrator 
to remotely access a server or one server in a group of servers and monitor the status of or 
administer the server from a remote location. Access to the server may be through dedicated 
dial-in to the server management device, or by using the world wide web (WWW) via a local 
25 area network (LAN) connection, wide area network (WAN) connection or dial-up service to 
an Internet service provider (ISP) for connection to the server management device. 

[005] Remote management consoles may have a pointing device such as a mouse that along 
with a GUI allows interaction with the server management device. The GUI may be 
displayed in a WWW browser such as Internet Explorer® or Netscape Navigator®. Software 
30 executing on the server may be available to the system administrator through the GUI on the 
remote management console. Thus, the GUI in the remote management console may allow 
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the system administrator to view software as if the system administrator was in front of the 
actual server display screen. The administrator may use the keyboard and pointing device of 
the remote management console to interact with software running on the server. 

5 [006] One issue with using a pointing device of the remote management console to interact 
with the server is lack of pointer synchronization. Mis-synchronization is primarily due to 
the inexact nature of pointing devices such as a mouse. A mouse typically signals relative 
movement to an operating system executing on the computer system to which the mouse is 
attached. The operating system interprets this data according to various user settings and 

10 changes the position of the pointer on the GUI of the computer system display screen. 

However, when the output signals from the mouse of the remote management console are 
also directed to the server through the server management device, the operating systems on 
the remote management console and server may interpret the output signals differently. This 
difference in interpreting the mouse output signals is because each operating system may 

15 have different settings for mouse sensitivity, acceleration, and so forth. Since the operating 
system of the remote management console and server may transform the relative movement 
of the mouse into different pointer display coordinates, the pointer within the two GUIs may 
no longer be synchronized. 

20 [007] In addition, the server may re-position the pointer based on user specified settings. 
For example, if the user configures the server operating system to move the pointer to the 
"OK" button when a pop-up dialog box is displayed, the remote management console may 
not be communicated this change to adjust its pointer. Although additional software could be 
employed on the server to communicate pointer changes back to the remote management 

25 console, this technique requires additional software to be installed on every managed server. 
Additionally, such software may not be present during operating system initialization or 
installation. Thus, it is difficult for the pointer position on the remote management console to 
remain synchronized to the pointer position on the server. 

[008] Server management devices typically perform input redirection by creating a virtual 
30 input device that may temporarily replace or enhance an input device of the server. This 

virtual device typically is designed to model the input device used on the remote management 
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console by presenting the same device to the server thus redirecting the input device from the 
remote management console to the server. 

SUMMARY 

[009] In general, according to one embodiment, a method of remotely accessing a 
5 computer system by a remote console includes receiving, by an emulation device, first 

pointer position data representing a position of a first pointing device coupled to the remote 
console. The emulation device emulates a second pointing device that is of a different type 
than the first pointing device. The emulation device generates second pointer position data 
representing a position of the second pointing device based on the received first pointer 
10 position data. 

[0010] Other or alternative features will become apparent from the following description, 
from the drawings, and from the claims. 

15 BRIEF DESCRIPTION OF THE DRAWINGS 

[001 1] Fig. 1 is a block diagram of an example arrangement that includes a remote 
management console, a server management device, and a server, in accordance with an 
embodiment. 

[0012] Fig. 2 is a block diagram of a server coupled to a server management device, in 
20 accordance with an embodiment. 

[0013] Fig. 3 is a block diagram of a server management device in accordance with some 
embodiments of the invention coupled to the server of Figure 2. 

DETAILED DESCRIPTION 

25 [0014] Fig. 1 illustrates an example arrangement in which a remote management console 
100 is coupled over a network 102 to a server management device 104 to enable an 
administrator at the remote management console 100 to manage the status of or to administer 
a server 106. The server 106 is coupled to the server management device 104. Alternatively, 
the server management device 104 can be part of the server 106. Administrators can locally 

30 use a pointing device 105 (e.g., a mouse), a keyboard 109, and a monitor 107 that are 
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connected to the server 106 to perform administrative tasks with respect to the server 106. A 
display 108 (which includes a pointer or cursor 125) of the server 106 can be displayed on the 
monitor 107. As used here, the term "display" refers to the display data that is stored or 
generated in a computer system, such as the server 106. The display is converted to output 
5 signals sent to a monitor where the display is presented. Note that the pointing device 105, 
keyboard 109, and monitor 107 are optional devices that are not connected to the server 106 
in some arrangements. 

[0015] In an alternative arrangement, a pointing device, keyboard, and monitor can be 
connected to the server management device 104 for enabling access to the server 106. 

10 [0016] In accordance with some embodiments, if an administrator is at a location that is 
remote from the server 106, the administrator can perform administrative tasks with respect 
to the server 106 by using the remote management console 100. Although only one remote 
management console is shown in Fig. 1, more than one remote management console can be 
coupled to the server management device 104 over the data network 102. Examples of the 

15 data network 102 include a local area network (LAN), a wide area network (WAN), or a 

public network such as the Internet. In another embodiment, instead of the data network 102, 
another type of link can be used to couple the remote management console 100 to the server 
management device 104, such as a dial-in connection. 

[0017] Examples of the remote management console 100 include a personal digital assistant 
20 (PDA), packet network-enabled mobile phone, or any other device capable of establishing a 
communication session with the server management device 104 and displaying a graphical 
user interface (GUI). The GUI displayed may be the GUI of a browser or other application. 
The remote management console 100 includes various input devices, such as a keyboard or 
keypad 1 10, a pointing device 112 (e.g., a mouse, touchpad, trackball, tablet, touch screen, 
25 and so forth), and a display 114. Although not shown, the display 1 14 is presented for output 
on a monitor, liquid crystal display (LCD), or any other appropriate display device. 

[0018] A pointing device such as a mouse, touchpad, or trackball is a relative pointing 
device. With a relative pointing device, movement of the pointing device 1 12 is indicated by 
a change in position (relative pointer position data) to an operating system 1 16 of the remote 
30 management console 100. The relative pointer position data according to some 

implementations is in the form of relative pointing device coordinates. "Movement of a 
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pointing device" refers to movement of a mouse, movement of a user's finger over a 
touchpad, rotation of a trackball, and any other actuation of a pointing device that indicates 
that a corresponding pointer or cursor 120 displayed by the display 1 14 of the remote 
management console 100 is to be moved. As used here, the term "pointing device" refers to a 
device that receives an indication of user actuation (such as movement of a mouse or 
trackball or movement of a user's finger over a touchpad) as well as any control logic that 
provides an indication of movement in response to the indication of user actuation. "Pointing 
device" is intended to cover either an actual pointing device or a virtual or emulated pointing 
device. 

[0019] The operating system 1 16 of the remote management console 100 transforms the 
relative pointer position data provided by the relative pointing device 112 into absolute 
pointer position data (such as absolute pointing device coordinates) to represent the position 
of the cursor 120 in the display 114. The absolute pointer position data is communicated to 
an application software 122 running in the remote management console 100. The operating 
system 116 adjusts the position of the cursor 120 in the display 1 14 based on the absolute 
pointer position data. As used here, "absolute pointer position data" refers to data that 
indicates a position of a pointer or cursor in a grid of predefined size. Absolute pointer 
position data is distinguished from relative pointer position data in that relative pointer 
position data indicates change of position from a previous position, rather than a specific or 
absolute position within a predefined grid. 

[0020] An issue associated with remote access of the server 106 by the remote management 
console 100 is that the operating system 1 16 of the remote management console 100 and an 
operating system 126 of the server 106 may interpret movement of the pointing device 1 12 
differently in response to relative position coordinates from the pointing device 112. 
Typically, an operating system has various settings with respect to pointing devices, such as 
sensitivity, acceleration, and other settings. Different settings may cause movement of a 
pointing device to be interpreted differently by the remote management console 100 and the 
server 106, which may cause pointer mis-synchronization to occur if relative pointer position 
data is simply communicated from the remote management console 100 to the server 106 
through the server management device 104. 
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[0021] Alternatively, the application software 122 may not have direct access to the relative 
movement of the mouse signals due to abstraction in the operating system 116 of the remote 
management console 100. In this case, the application software 122 derives the relative 
movement data by measuring pointer displacement with respect to an update interval (by 
5 computing a derivative of displacement data with respect to time). In both cases, relative 
pointer position data is either directly received by the pointing device 1 12 or derived by the 
application software 122. 

[0022] To address the mis-synchronization issue, in accordance with some embodiments of 
the invention, the server management device 104 enables accurate positioning of a cursor 125 

10 in the display 108 of the server 106 in response to movement of the pointing device 1 12 at the 
remote management console 100. The server management device 104 accomplishes the 
accurate positioning of the cursor 125 by emulating a pointing device that is of a different 
"type" from the pointing device 1 12. The pointing device emulated by the server 
management device 104 is one that provides absolute pointer position data in response to 

15 pointing device actuation. Two pointing devices are of different "types" if they are different 
kinds of devices (such as a keyboard and mouse, a tablet and mouse, and so forth). A 
pointing device that is capable of operating in different modes can also be considered to be of 
different types. Thus, the pointing device operating in a first mode can be considered to be of 
a different type from the pointing device operating in a second mode. One specific example 

20 of pointing devices that operate in different modes are Universal Serial Bus (USB) human 

interface devices (HIDs) specified by the Universal Serial Bus (USB) Device Class Definition 
for Human Interface Device s(HID. Version 1.11. For example, an HID can operate in the 
mouse mode or in a tablet mode. 

[0023] The server management device 104 presents an input device to the operating system 
25 126 of the server 106. In one implementation, the input device presented by the server 
management device 104 is a USB HID. In accordance with some embodiments of the 
invention, the server management device 104 emulates a tablet or touch screen. A "tablet" or 
"touch screen" refers to any input device in which a user touches (either with the user's finger 
or a stylus or other like device) a screen or other template to indicate movement of a cursor in 
30 a display. A feature of a tablet or touch screen is that movement is reported as absolute 
coordinates to the operating system of the system to which the tablet or touch screen is 
coupled. In this case, the emulated tablet or touch screen is coupled to the server 106. In the 
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ensuing discussion, reference is made to "tablet device" to refer to a tablet, touch screen, or 
any other input device where cursor position is indicated by a user's finger or stylus. 

[0024] Thus, according to some embodiments of the invention, movement of the pointing 
device 1 12 in the remote management console 100 is indicated by absolute pointer position 
5 data communicated from the remote management console 100 to the server management 
device 104 over the data network 102. In some embodiments, the pointer position data is 
communicated in Internet Protocol (IP) packets to the server management device 104. The 
absolute pointer position data is generated by the operating system 1 16 of the remote 
management console 100 based on the relative pointer position data from the remote pointing 
10 device 112. 

[0025] In response to the absolute pointer position data from the remote management 
console 100, the server management device 104, which emulates a tablet device, also sends 
absolute pointer position data to the operating system 126 of the server 106. This process, 
described in further detail below, enables accurate positioning of the cursor 125 in the display 
15 108 of the server 106. 

[0026] According to one embodiment, the server management device 104 is coupled to one 
or more ports of the server 106, such as a USB port, a Peripheral Component Interconnect 
(PCI) port, and one or more PS/2 ports (as examples). 

[0027] Since the server management device 104 is emulating a tablet device, the server 
20 management device 104 informs the operating system 126 of the server 106 of the size and 

other characteristics of the tablet device. For example, the size of the tablet device may be 

represented as a grid of 3000 millimeters (mm) by 3000 mm (or some other arbitrary size). 

Absolute pointer position data provided by the server management device 104 to the 

operating system 126 of the server 106 indicates a position in the grid that makes up the 
25 emulated tablet device. The position in the tablet device grid is provided to the operating 

system 126 in response to pointer position data received from the remote management 

console 100. 

[0028] If transformation or scaling of the pointer position data generated by the operating 
system 1 16 of the remote management console 100 to pointer position data that represents a 
30 location in the tablet device grid is to be performed, then the transformation or scaling is 
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performed by the transformation application 124 (or other designated component) in the 
remote management console 100. In one implementation, the transformation application 124 
can be implemented as a JAVA module, although other types of modules can be used in other 
embodiments. The transformation application 124 has access to information (stored in the 

5 remote management console 100) that indicates the size of the tablet device being emulated 
by the server management device 104. The transformation application 124 receives absolute 
pointer position data from the operating system 1 16 in the remote management console 100 
and transforms or scales the received pointer position data into pointer position data of the 
emulated tablet device. Instead of performing the transformation in the remote management 

10 console 100, the transformation of pointer position data generated by the operating system 
1 16 of the remote management console 100 can be performed by the server management 
device 104. The transformed pointer position data is sent by the server management device 
104 to the operating system 126 of the server 106. 

[0029] Thus, according to some embodiments of the invention, to enable accurate 
15 positioning of a pointer based on movement of a remote pointing device (at a remote 

console), a computer system includes an emulation device (such as the server management 
device 104 discussed above) that emulates a second pointing device that is of a different type 
from the remote pointing device. The computer system receives pointer position data from 
the remote console, and in response to the received pointer position data, the emulation 
20 device provides pointer position data to software running in the computer system. In one 
embodiment, the remote pointing device is a relative pointing device that communicates a 
change of position using relative pointer position data. The relative pointer position data is 
transformed to absolute pointer position data, which is provided to the emulation device. The 
emulation device then provides absolute pointer position data to software in the computer 
25 system, which accurately positions a pointer or cursor in a display of the computer system. In 
this way, synchronized and accurate pointer movement control can be achieved between the 
remote console and the computer system. 

[0030] Referring to Fig. 2, according to an example arrangement, the server 106 may 
include one or more central processing units (CPU1-CPUN), one or more memory devices 
30 230, and a bridge device such as north bridge 220. The arrangement of the server 106 shown 
in Fig. 2 is provided for purposes of example, as other embodiments can employ other 
arrangements of the server 106. The CPUs may be Pentium® architecture, Xeon® 
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architecture, Itanium® architecture, POWERPC® architecture or any other type of CPU. The 
north bridge 220 may be coupled to one or more input/output bridges 291a, 291b through 
respective I/O buses 245a, 245b. The I/O bridge 291a is coupled to slots 292 (e.g., PCI 
slots). The I/O bridge 291b can be coupled to various peripheral devices (not shown). 

5 [003 1] Additionally, the north bridge 220 can be coupled to another bridge device such as a 
south bridge 280. The south bridge 280 may be coupled to storage devices, such as a ROM 
(read-only memory) 285. Additionally, in some embodiments, the south bridge 280 may be 
coupled to a super input/output (I/O) controller 287. The combination of the south bridge 
280 and super I/O controller 287 provides various I/O interface functions. Note that instead 
10 of two separate chips to provide the I/O interface functions, one chip or more than two chips 
can be used in other implementations. 

[0032] The south bridge 280 includes a USB host controller 290 that is connected to a USB 
device controller 202 in the server management device 104 through a USB bus 235. The 
server management device 104 can also be coupled to the server 106 through another type of 
15 interface (e.g., PS/2 interface 262, 265, PCI bus 275). A graphics controller 270 is coupled to 
the south bridge 280 over the PCI bus 275. 

[0033] The server management device 104 is coupled to, or includes, a communications 
interface (e.g., a network interface card or NIC 255), which enables the server management 
device 104 to communicate over the network 102 so that the server management device 104 
20 can receive pointer position data over the network 102. 

[0034] The server management device also optionally includes a legacy PS/2 keyboard and 
mouse logic 204 for receiving remote management console PS/2 keyboard and PS/2 relative 
mouse signals including relative pointer position data over the data network 102 through the 
NIC 255. The received PS/2 keyboard and relative mouse signals are generated by user 
25 interaction with the remote management console 100. The legacy keyboard and mouse logic 
204 provides legacy support to enable a conventional mechanism for receiving pointer 
position data from the remote management console 100. 

[0035] The legacy keyboard and mouse logic 204 outputs the PS/2 keyboard and PS/2 
relative mouse signals to first inputs of multiplexers 206. The second inputs of multiplexers 
30 206 are connected to the keyboard 109 and pointing device 105. The outputs of the 
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multiplexers 206 are connected to the PS/2 keyboard lines 262 and PS/2 mouse lines 265, 
which are connected to a keyboard controller (not shown) in the super I/O controller 287 of 
the server 106. The multiplexers 206 select between the first and second inputs to couple one 
of the keyboard/mouse signals from the legacy keyboard and mouse logic 204 and the 
5 keyboard/mouse signals from the keyboard 109 and pointing device 105 for output to the 
PS/2 interface of the server 106. In one implementation, the multiplexers 206 are separate 
from the server management device 104. In another implementation, the multiplexers 206 
reside within the server management device 104. 

[0036] Referring to Fig. 3, one example arrangement of the server management device 104 

10 is shown in greater detail. Note that different arrangements of the server management device 
104 can be used in other embodiments. The server management device 104 may be 
implemented in an ASIC (application specific integrated circuit) device or other type of 
component. The server management device 104 can be mounted on the main circuit board of 
the server 106, or alternatively, the server management device 104 can be plugged into a slot 

15 or port of the server 106. For example, the server management device 104 has a PCI bus 
connector 310 that can be plugged into the PCI slot 292 of the server 106. The PCI bus 
connector 310 is coupled to firewall 315 and bridge logic 320 through bus 345, which in 
some embodiments may be a 32-bit internal bus. Firewall 315 and bridge logic 320 enable a 
processor 355 of the host management device 104 to isolate and control the flow of 

20 information between the host computer system (the server 106) and the server management 
device 104. The firewall 315 protects against unauthorized access through the PCI bus and 
shields sensitive information that may be stored in the server management device 104. This 
sensitive information may be located in a memory 370 (e.g., DRAM) or in non-volatile 
memory 375 (e.g., FLASH ROM) of server management device 104. Access to the 

25 memories 370 and 375 is provided by a memory controller 355. 

[0037] Host power and fault isolation 350 splits the server management device 104 into two 
separate areas: a first area that operates under normal host computer system power, and a 
second area (indicated as 385) that operates under a separate auxiliary power. Server power 
and fault isolation module 350 monitors the host computer system for any unexpected 
30 behavior such as a host computer system power failure. If a power failure occurs, processor 
355 in the second area 385 continues to operate normally on auxiliary power. The processor 
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355 and other components in the second area 385 operating on auxiliary power continue to 
provide the following services: web browser access, alerts, access to event logs, and so forth. 

[0038] The processor 355 of the server management device 104 provides the "brains" of the 
various server management tasks performed by the server management device 104 with 
5 respect to the server 106. An operating system (separate from the operating system 126 of 
the server 106) is executable on the server management device 104. 

[0039] A system monitoring module 325 is also coupled to PCI bus connector 310 through 
bus 345 to monitor hot-plug fans, power supplies, environmental sensors, and various other 
components of the server 106. The system monitoring module 325, in some embodiments, 
10 may reboot the server 106 automatically after a recoverable hardware or software fault occurs 
in the system. 

[0040] A remote console functionality module 340 enables hardware-based remote 
management device functions. In some embodiments, the remote console functionality 
module 340 monitors a bus of the server 106 for video activity so that video information can 

15 be captured and transmitted to the remote management console. In addition, the remote 
console functionality module 340 includes the legacy PS/2 keyboard and mouse logic 204 
(Fig. 2). The legacy PS/2 keyboard and mouse logic 204 includes virtual keyboard logic 330 
and virtual mouse logic 335 that receive remote management console PS/2 keyboard and 
PS/2 relative mouse signals over the data network 102 through the NIC 255. The remote 

20 management console keyboard and relative mouse signals are received by the processor 355, 
which controls the virtual keyboard logic 330 and virtual mouse logic 335. The virtual 
mouse logic 335 in the remote console functionality module 340 provides legacy support to 
enable a conventional mechanism for receiving pointer position data. The virtual mouse 
logic 335 receives relative pointer position data rather than absolute pointer position data 

25 from the remote management console 100. 

[0041] According to some embodiments, instead of using the virtual mouse logic 335 to 
receive relative pointer position data, the USB device controller 202 in the server 
management device 104 is used to emulate a tablet device to the server 106, as discussed 
above. The USB device controller 202 receives absolute pointer position data over the data 
30 network 102. The USB device controller 202 identifies to the operating system 126 (Fig. 1) 
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of the server 106 that it is coupled to a USB HID, which in this case is the emulated tablet 
device. 

[0042] The server management device 104 may also include a universal asynchronous 
receiver/transmitter (UART) 378 coupled to bus 345. The UART 378 may be connected to a 
5 modem/serial terminal server 380 that is capable of dial-in connection and communication 
with the remote management console 100. Thus, instead of communicating pointer position 
data through the NIC 255, the server management device 104 can communicate pointer 
position data through the modem/serial terminal server 380. 

[0043] In the implementation depicted in Figs. 2 and 3, the server management device 104 
10 emulates a USB tablet device, which is coupled to a USB host controller (290) in the server 
106. In another embodiment, the server management device 104 can emulate both the tablet 
device and the USB host controller. In this case, a separate USB host controller does not 
have to be used to perform accurate pointer control in response to position data from the 
remote management console 100. The server management device 104 in this alternative 
15 configuration can send absolute pointer position data to a bus in the server 106 (such as a PCI 
bus) to communicate the pointer position data to the operating system 126 of the server 106. 
This alternative arrangement avoids having to send pointer position data in USB signals to 
the USB host controller. 

[0044] The various tasks discussed above can be performed by hardware, firmware, or 
20 software, or any combination of the above. Firmware and software are executable on a 

microcontroller, microprocessor, or other control unit. As used here, a "controller" refers to 
hardware, firmware, software, or a combination thereof. A "controller" can refer to a single 
component or to plural components (whether software, firmware, or hardware). 

[0045] Data and instructions of the software and firmware are stored on one or more 
25 machine-readable storage media. The storage media include different forms of memory 

including semiconductor memory devices such as dynamic or static random access memories 
(DRAMs or SRAMs), erasable and programmable read-only memories (EPROMs), 
electrically erasable and programmable read-only memories (EEPROMs) and flash 
memories; magnetic disks such as fixed, floppy and removable disks; other magnetic media 
30 including tape; and optical media such as compact disks (CDs) or digital video disks (DVDs). 
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[0046] While the present invention has been described with respect to a limited number of 
embodiments, those skilled in the art will appreciate numerous modifications and variations 
there from. It is intended that the appended claims cover all such modifications and 
variations as fall within the true spirit and scope of this present invention. 



